(19) 



JAPANESE PATENT OFFICE 



PATENT ABSTRACTS OF JAPAN 

(11) Publication number: 08313217 A 

(43) Date of publication of application: 29.1 1 .96 



(51) Int el 



G01B 11/02 
G06F 17/50 
G06T 7/00 
G06T 1/00 



(21) Application number: 07146809 

(22) Date of filing: 22.05.95 



(71) Applicant: 

(72) Inventor: 



MITSUTOYO CORP 
KOMATSU KOICHI 



(54) NONCONTACT IMAGE MEASURING SYSTEM 

(57) Abstract: 

PURPOSE: To provide a noncontact image measuring 
system which can display easily the part to be measured. 

CONSTITUTION: A monitoring image window 41 and a 
stage image window 42 are produced on a display screen 
of a CRT display. A monitored image showing a part of a 
workpiece 12 of which the image is picked up presently 
by a CCD camera is displayed in the monitoring image 
window 41 , while a stage image being an overall image 
obtained by picking up the Image of the wori<piece 12 
overall by the CCD camera is displayed in the stage 
image window 42. While it is made possible to specify an 
arbitrary position in the stage image, a position in a 
workpiece coordinate system corresponding to the 
position in the overall image of the workpiece 12 is 
calculated in response to this specification of the 
position, and the CCD camera is moved to the specified 
position in the workpiece 12. Therefore an enlarged 
image of a desired position in the workpiece 12 can be 
displayed in the display screen by a very simple operation. 
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Translation of the Pertinent Descriptions: 

[Abs-kract] 

[Object] The invention is to provide a system for measuring, 
non-contact images that can easily display a portion to be measured - 
[Means to solve the problem] A monitor image window 41 and a stage 
image window 42 are generated on a display screen of the CRT display. 
On the monitor image window 41, a monitor image is displayed a part 
of a work 12 that is currently photographed by a CCD camera. On 
the stage image window 42, a stage image is displayed an entire 
image that is obtained by photographing the work 12 wholly by the 
CCD camera . By enabling a designation of an optional position within 
the stage image as well as by calculating a position of work 
coordinate system which corresponds to the position of entire image 
of the work 12 in response to the position designation, the CCD 
camera is moved to the designated position in the work 12. Thus, 
it is possible to display in the display screen an enlarged image 
of a desired position of the work. 12 with extremely easy operation. 

Column 4 [0016] to colxamn 7 [0025] : 

[0016] A main body of computer 21 comprises a CPU, a ROM, a RAM 
and a hard disc device, etc. In combining with software, various 
functions are realized as shown in Fig. 2. Namely, a monitor image 
window generation section 31 and a stage image window generation 
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section 32 generate on the display screen of the CRT display 25, 
such as shown in Fig. 3, a monitor image window 41 (a first window) 
and a stage image window 42 (a second window) . The monitor image 
window 41 is displayed the monitor image showing a part of the work 
12 that is currently photographed by the CCD camera 18. The stage 
image window 42 is displayed the stage image that is obtained by 
photographing the entire image of the work 12 by the CCD camera 
18, The monitor image and the stage image taken in by the CCD camera 
18 are stored separately in each storage area of an image memory 
33. The stage image has a large volume of information due to the 
entire image of the work 12, Thus, the stage image read from the 
image memory 33 is displayed in the stage image window 42 after 
compressed appropriately by the image processing section 34. As 
for methods for compression, for example, a jumping scanning of 
every other line or such process as a multi-valued image into a 
two-valued image, etc. may be taken. 

[0017] While, an x direction pulse Px and a y direction pulse Py 
supplied from a mouse 24 are counted by a mouse driver 35. Thereby, 
a cursor position information x and y is outputted from the mouse 
driver 35, A cursor generation section 36 generates a cursor 43 
displaying the position x, y in the mouse coordinate system (a 
coordinate system of the display screen) , as shown in Fig. 3, based 
on the cursor position information x and y outputted from the mouse 
driver 35. 

[0018] A display screen generation section 37 composites the monitor 
image window 41 generated by the monitor image window generation 
section 31 and the stage monitor image window 42 generated by the 
stage image window generation section 32 so as not to lay over on 
the display screen, and a display screen is generated in which the 
cursor 43 generated by the cursor generation section 36 is arranged 
on the display screen and supplies to the CRT display 25. 
[0019] While, the mouse driver 35 detects a click signal S of the 
mouse 24, in addition to output the cursor position information 
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X and y. The click signal S and the cursor position information 
X and y are supplied to a command identification section 38. When 
the click signal S of the mouse 24 is detected in the condition 
where the cursor 43 is positioned in various kinds of command box 
not shown on the display screen, the command identification section 
38 identifies commands that should be started. A measuring process 
and position calculation section 39 starts an image processing 
section 34 based on the commands started by the command 
identification section 38, and calculates predetermined 
measuring values to the monitor image within the image memory 33 
by generating a tool for detecting edges, and giving each process 
such as a two-valued process and an edge detection, etc. In advance 
to the measuring process,. the measuring process and position 
calculation section 39 controls a drive control section 4.0, 
executes a process for taking in the stage image extending to the 
entire work 12, calculates the designation position in the actual 
work coordinate system from the designation position in the mouse 
coordinate system when the optional position on the stage image 
window 42 is designated, and moves the CCD camera 18 to the 
designation position by controlling the drive control section 40. 
[0020] Next, the operation of thus constructed system of measuring 
the non-contact image will be explained. To simplify the 
explanation here, an origin and a reference axis of the machine 
coordinate system and an origin and a reference axis of the. work 
coordinate system of the system are matched by a preliminary operation . 
Further, the work coordinate system is indicated by X,Y,Z and the 
mouse coordinate system is indicated by x,y,2. Before starting to 
measure, the CCD camera 18 is set at an optional position of the 
work 12 by manual or automated focus processes. Next, by the 
operation of the mouse 24, when clicking ''a stage image take-in" 
button (not shown) , a stage image take-in process of the measuring 
process and position calculation section' is started. 
[0021] Fig. 4 is a flowchart showing a stage image take-in process. 
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Firstly, in a position Z focused in advance, a horizontal component 
Ax and a vertical component AY of a visual field shown on the 
monitor from a power L of a current object lens are calculated (SI) . 
The stage is moved to the initial position (the original position 
of the work coordinate system) at the most upper left (S2), and 
the work 12 is photographed at that position (S3) . The photographed 
image as well as the stage coordinates Xi, Yi, Z thereof and the 
lens power L are saved in the image memory 33 (S4) . Next, whether 
or not it is a dead-end position of the lateral direction (X direction) 
is judged (S5) . If it is not the dead-end position of the lateral 
direction as a result of judgment, the stage is moved as much as 
the horizontal component AX of the visual field of the. monitor 
to the lateral (right) position (S6) , and the image take-in is again 
performed at that position (S3, 84) . The information to be saved 
is only the stage coordinates X, Y. While, if it is the dead-end 
position of the lateral direction, whether or not it is also the 
dead-end position of the longitudinal direction (Y direction) is 
judged (S7) - If it is not the dead-end position of the longitudinal 
direction as a result of judgment, the stage is moved as much as 
the vertical component AY of a visual field of the monitor to the 
longitudinal (lower) direction (S8) . The work 12 is photographed 
at the position thereof (S3), and the photographed image as well 
as the stage coordinates Xn, Yn are saved (S4) . A stage move of 
the next lateral direction is conducted a reverse direction than 
that of the previous time (S6) . While, if it is the dead-end position 
of the longitudinal direction, a stage image window is generated 
(S9) . 

[0022] The entire image of the work 12. is taken-in the image memory 
33 by repeatedly taking-in the stage image as mentioned above until 
the stage is moved to a final position of the dead-end position 
of the both lateral and longitudinal directions. The judgment 
whether or not the stage image are in the dead-end positions of 
the lateral and longitudinal directions may be made by a method 

4 



of calculating, for example, a camera position and a stage position 
which are predetermined by machinery, a size of one pixel and a 
displacement quantity of a position of axis of lens (an offset value) 
after adjusted by a size information and a currently used lens, 
etc., to give the measuring process and position calculation 
section 39 a scope of work 12 in advance. 

[0023] Fig. 5 shows an example of a stage image window when six 
pieces of the stage image are taken-in. In an inner display area 
44 of the stage image window 42, the entire image of the work 12 
are displayed based on the stage coordinates X, Y, Z and the lens 
power L. Next, when the predetermined position of the display area 
44 is designated by the operation of the mouse 24, a process for 
moving the CCD camera 18 to the designated position of the work 
12 will be explained. 

[0024] Fig. 6 is a flowchart showing a moving process of the CCD 
camera 18 in the measuring process and position calculation section 
39. First, as shown in Fig. 3(a), the cursor 43 is moved to a portion 
to be measured of the work, 12 by the operation of the mouse 24, 
a position P=(x, y) based on the mouse coordinate system of the 
cursor 43 is obtained after clicking the predetermined button of 
the mouse 24 (S12) . Next, whether or not it is within the display 
range that displayed the stage image window 42 is judged (S13) , 
If it is in the display range as a result of judgment, a position 
(X, Y) based on the work coordinate system which correspond to a 
position P=(x, y) based on the mouse coordinate system is obtained 
(S14) . Namely, assume that the original position Po in the mouse 
coordinate system of the stage, image window 42 is (xo,yo)f the 
designation position P=(X,Y) in the work coordinate system is 
obtained by X-a(x-xo) and Y=j3(y-yo). Here, the a and ^ are 
factors showing a unit length of the work coordinate system to a 
unit length of the mouse coordinate system. 

[0025]' Next, the measuring process and position calculation section 
39 moves the stage so that the center of the CCD camera 18 locates 
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in X, Y of the work coordinate system (S15) , and photographs the 
work 12 at that position (S16) . Thereby, the work 12 is shown in 
the monitor image window 41 in the manner that the portion P' to 
be measured of the work 12 becomes the center of the display area 
45 of the monitor image window 41 as shown in Fig. 3(b), 
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